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(54) Method and system for camera with motion detection 



(57) A motion detection camera system which may 
be used as a security camera includes an active pixel 
imaging system (3) operable in a video and differential 
mode connected to a mode activation circuit (4) that con- 
trols the imaging system mode. In the video mode, the 
imaging system generates an output signal containing 
information of a viewed area on a frame by frame man- 
ner. In the differential mode, the imaging system gener- 
ates a differential output signal containing information 
consisting of the differences in the viewed area between 
adjacent detected frames. Normally, the imaging system 
camera is operated in the differential mode. If no motion 
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occurs in the viewed area, the corresponding differential 
output signal representing the interframe differences will 
have a constant signal level. Upon detecting that the dif- 
ferential output signal deviates by greater than a thresh- 
old level indicating motion in the viewed area, the mode 
activation circuit (4) causes the imaging system (3) to 
operate in its video mode. The corresponding generated 
video output signal of the imaging system is then pro- 
vided to monitoring equipment, such as a video cassette 
recorder (2) for recording of the motion in the viewed 
area. 
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Description 

Field of the Invention 

This invention relates generally to improvements in 
video security cameras, and more specifically to an 
active pixel sensor based camera capable of motion 
detection. 

Background of the Invention 

Security camera systems often monitor areas where 
individuals are not normally present for substantial peri- 
ods of time, such as display cases containing store mer- 
chandise during non-business hours or activities within 
bank vaults. Typically, such security camera systems 
employ video recording equipment to record images of 
the viewed area. Since no or little motion occurs within 
these viewed areas over long periods of time it is desir- 
able to record images of the viewed area only when 
motion occurs. Such motion may be caused by individu- 
als, whether lawfully or illegally, entering the viewed 
area- 
Some prior art security cameras have employed 
external motion detectors, such as infra-red or micro- 
wave motion detector devices, to activate the recording 
equipment associated with the cameras when motion is 
detected in the viewed area. A drawback to such systems 
is there high cost and bulk. Typically, the relative large 
size of the camera and motion detector arrangement of 
the system are unsightly and difficult to hide. 

A smaller prior an motion detection arrangement 
employs a video camera, an analog-to-digital converter, 
a frame buffer and a system controller to detect motion 
by sensing interframedifferences in the video signal gen- 
erated by the video camera. In this arrangement, the 
video signal generated by the camera is digitized by the 
analog-to-digital converter. The digitized signal for each 
video frame is temporally buffered in the frame buffer 
where the controller compares it with the respective next 
generated frame information to detect if motion has 
occurred between the frames. When motion is detected, 
the video signal is provided to a recording device. 
Although this arrangement eliminates the need for a sep- 
arate motion detector, it is complex and costly. 

Therefore, a need exists for a low cost, compact 
security camera sysfem with built-in motion detection. 

Summary of the invention 

In one embodiment of the present invention, a sys- 
tem for a camera with motion detection comprises an 
active pixel imaging system operable in a differential or 
video mode, and a mode activation circuit. A mode select 
output of the activation circuit is connected to a mode 
select input of the imaging system and a signal input of 
the activation circuit is connected to an imaging system 
output. The imaging system operates in the differential 
or video mode based on the signal at its mode select 



input. When in the video mode, the imaging system gen- 
erates a video signal containing information for each 
detected image frame of a viewed image, and when in 
the differential mode, the imaging system generates a 

5 differential signal containing information of interframedif- 
ferences. An imaging system capable of operating in 
such modes may employ active pixel sensors that buffer 
signals corresponding to a previous frame's detected 
light intensity during the detection of a present frame's 

w light intensity. 

In operation, the mode activation circuit causes the 
imaging system to operate in its differential mode by pro- 
ducing a signal in a first logic level at the mode select 
output. If no motion occurs in the viewed area, the cor- 

75 responding differential output signal representing the 
interframe differences is at a constant signal level. Upon 
sensing that the corresponding generated differential 
output signal level changes from the constant level by 
greater than a threshold value indicating motion in the 

20 viewed area, the mode activation circuit causes the 
imaging system to operate in its video mode by generat- 
ing a signal at the mode select output in a second logic 
level. The mode activation circuit provides the corre- 
sponding video signal generated by the imaging system 

25 to the mode activation circuit output where it may be used 
by associated monitoring equipment. 

One suitable mode activation circuit includes a 
switch, a threshold detector and a mode selector. The 
switch has an input for receipt of the imaging system out- 

30 put signal, a first output that provides any generated 
video signals to a monitoring device such as video 
recording equipment and a second output that provides 
the generated differential output signal to the threshold 
detector. The threshold detector monitors the differential 

35 output signal to determine if the signal level exceeds the 
threshold level. If the differential output signal exceeds 
the threshold level, the threshold detector provides a cor- 
responding signal to the mode selector which controls 
the imaging system mode and the position of the switch. 

40 The present invention may be used as a low cost, 
compact security camera that may be implemented on a 
single chip and that as a result may be small and easy 
to hide. A region of interest for motion detection may be 
precisely defined by setting the field of view of the cam- 

45 era system, such as with a conventional lens. Further- 
more, the field of view and correspondingly, the motion 
detection region may be adjusted by simply adjusting the 
lens or changing to a different lens. 

Additional features and advantages of the present 

50 invention, will become apparent by reference to the fol- 
lowing detailed description and accompanying drawings. 

Brief Description of the Drawings 

55 FIG. 1 is a schematic diagram of an exemplary cam- 

era system in accordance with the present invention; 
FIG. 2 is a schematic diagram of an exemplary active 
pixel sensor and output circuit which may be used 
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an imaging system of the camera system of FIG 



FIG. 3 is a timing diagram illustrating exemplary 
operation of the circuit of FIG. 2 for motion detection 
and 

FIG. 4 is a timing diagram illustrating exemplary 
operation of the circuit of FIG. 2 for producing a video 
signal. 



Detailed Description 

FIG. 1 shows an exemplary camera system 1 
according to the present invention connected to a mon- 
itoring device such as a video recorder 2. The camera 
system 1 includes an active pixel sensor camera 3 capa- 
ble of operating in a differential or video mode connected 
to a mode activation circuit 4. The camera system 1 is 
shown connected to the video recorder 2 for ease of illus- 
tration purposes only. An alternative suitable monitoring 
device includes an alarm, alone or in combination with 
the video recorder 2. to alert security personnel or police 
of the detected motion in the viewed area. Also, a televi- 
sion monitor may be used with or without an alarm to 
permit security personnel to monitor the area from a 
remote security station when motion is detected. 

A presently preferred active pixel sensor imaging 
system which may suitably be used as the active pixel 
sensor camera 3 is illustrated within the block outline of 
the camera 3 and described in detail in U.S. Patent Appli- 
cation No. 08/323,203. entitled "ACTIVE PIXEL SEN- 
SOR AND IMAGING SYSTEM HAVING DIFFERENTIAL 
MODE." filed October 14. 1994. which is assigned to the 
assignee of the present invention and incorporated by 
reference herein. The active pixel sensor imaging sys- 
tem of the camera 3 includes an array of active pixel sen- 
sors 5. a row decoder 10. a plurality of output circuits 18 
and a t.m.ng controller 20. The active pixel sensor array 
5 consists of eight rows 25 and eight columns 30 of 
w> closely spaced active pixel sensors 35. The active pixel 
sensor array 5 is shown as a eight-by-eight sensor array 
for illustrative purposes only and is not meant to be a 
limitation on the present invention. An active pixel sensor 
array which may be used in the camera system 1 may 
consist of any number of row and columns of active pixel 
sensors, and should preferably consist of a sufficiently 
large number of pixels to obtain the desired resolution of 
video information in the output signal. 

Each active pixel sensor 35 is capable of converting 
a detected quantity of light to a corresponding electrical 
signal at an output 50. A plurality of control lines 55 
extend from the row decoder 10 and connect to each 
sensor 35 in a respective sensor row 25. The control 
lines 55 connected to each sensor 35 consist of a pho- 
togate control line 180. a reset control line 184 and a 
select control line 186, as shown in FIG. 2. Each sensor 
output 50 in the corresponding sensor column 30 is con- 
nected by a column output line 65 to a particular output 
circuit 18. Each output circuit 18 is further connected to 
a common imaging system output line 15. 



The common output line 15 is connected to the 
mode activation circuit 3. An exemplary mode activation 
circuit 4 is illustrated in FIG. 1 and includes a switch 70 
a threshold detector 80 and a mode selector 90 The 
5 common imaging system output line 1 5 of the imaging 
system 3 is connected to the switch 70. The switch 70 is 
further connected to the video recorder 2 and the thresh- 
old detector 80. The switch 70 is operable in first and 
second positions to connect the common output line 15 
10 to the threshold detector 70 or video recorder 2 respec- 
tively. The threshold detector 80 is also connected to the 
mode selector 90. The mode selector 90 is further con- 
nected to the timing controller 20 within the imaging sys- 
tem 3 and a control input 71 of the switch 70. 
'5 In operation, whether in the differential or video 
modes, the timing controller 20 of the imaging system 3 
provides timing signals to the row decoder 10 which 
sequennally activates each row 25 of active pixel sensors 
35 via the control lines 55 to detect light intensity and to 
20 generate corresponding output voltage signals during 
each frame interval. A frame, as used herein, refers to a 
single complete cycle of activating and sensing the out- 
put from each sensor 35 in the array 5 a single time over 
a predetermined frame time period. The timing of the 
25 imaging system 3 is controlled to achieve a desired frame 
rate, such as 30 frames per second. 

When detecting a particular image frame of the 
viewed area, each sensor row 25 may be activated to 
detect light intensity over a substantial duration of the 
30 frame interval. In the time remaining after the sensor row 
25 has detected the light intensity for the frame each of 
the respective sensors 35 within the row 25 simultane- 
ously generates output voltage signals corresponding to 
the amount of light detected by that sensor 35 If an 
35 ,mage is focused on the sensor array 5 by. for example 
a conventional camera lens, then each pixel sensor 35 
generates an output voltage signal corresponding to the 
light intensity for a portion of the image of the viewed 
area focused on that sensor 35. The output voltage sig- 
<o nals generated by the activated sensor row 25 are simul- 
taneously provided to the respective output circuits 18 
via the column output line 65. 

The output circuits 18 generate either difference or 
video output signals based on the corresponding 
"5 received sensor output signals and the operating mode 
of the imaging system 3. The generated output signals 
are provided to the output line 15 in a serial fashion to 
form a differential or video output signal for the corre- 
sponding image frame based on timing control signals 
so from the timing controller 20. The timing controller 20 
controls the row decoder 10 and plurality of output cir- 
cuits 18 to continuously generate an output signal for 
consecutive frames at the predetermined frame rate. 
When operating in the video mode, the video output 
55 signal comprises information for each detected image 
frame of the viewed area. When operating in the differ- 
ential mode, the differential output signal comprises 
information corresponding to the difference between 
adjacent detected image frames of the viewed area. If 
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there is no motion or change in the viewed area that is 
detected by the imaging system 3. then no mterframe 
differences exist and the differential output signal is gen- 
erated at a constant level, such as at zero volts, h. now 
ever a change appears due to motion in the yjewed 
image between consecutive frame readouts, such as 
when a person enters the viewed area, then the imaging 
system 3 generates a corresponding differential output 
signal that is not constant. 

The imaging system 3 is normally operated in the 
differential mode with the switch 70 in its first position 
such that the differential output signal on the common 
line 15 is supplied to the threshold detector 80. The 
threshold detector 80 generates a digital output signal at 
a first logic level when the differential output signal is 
below a threshold signal level and at a second logic level 
when the differential output signal is above the tnreshold 
signal level. The threshold signal level should be 
selected such that its signal level is greater than the sig- 
nal level of the differential output signal representing the 
viewed area without motion, and less than the differential 
output signal when motion is detected. Accordingly, the 
threshold detector 80 generates an output signal at a first 
logic level when no motion is present in the v.eweo area. 

The threshold detector digital output signal is pro- 
vided to the mode selector 90. Based on the logic level 
of the threshold detector digital output signal, the mode 
selector provides a mode signal to the timing controller 
20 to cause the imaging system to operate in the differ- 
ential or video mode. When the threshold detector digital 
output signal is at a first logic level indicating that no 
motion is detected, the mode selector 90 generates the 
mode signal to maintain the imaging system operation 
in the differential mode. The mode signal generated by 
the mode selector 90 is also provided to the switch con- 
trol input 71. When the imaging system 3 is operated in 
the differential mode, the switch is maintained m its first 
position to provide the generated differentia! output sig- 
nal to the threshold detector 80. 

When the image in the viewed area changes, such 
as when a person enters the viewed area, the signal level 
of the corresponding generated differential outout signal 
will exceed the threshold level causing the threshold 
detector 80 to generate the digital output signal at the 
second logic level. In response, the mode selector 90 
generates the mode signal to cause the timing controller 
20 to operate the imaging system 3 in the video mode 
and cause the switch 70 switch to its second position. As 
a consequence, the corresponding generated video out- 
put signal is provided to the video recorder 2. At a pre- 
determined time duration later, the mode selector 90 
generates the mode output signal to cause the imaging 
system 3 to revert back to its differential mode and the 
switch 70 to switch to its first position to confirm contin- 
ued movement in the viewed area. In addition, the mode 
selector 90 may also be connected to the video recorder 
2 or other monitoring equipment to alert such equipment 
that motion has been detected and that a video signal of 
such motion is being generated. 
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A suitable threshold detector 80 is a comparator'with 
a positive input connected to the switch 70 and a nega- 
tive input connected to a voltage source that generates 
a desired threshold voltage. An output of the comparator 
generates the digital output signal and is connected to 
the mode selector 90. The mode selector 90 may consist 
of a suitable combinational logic circuit, programmable 
logic array, f inite state machine implementation such as 
application specific integrated circuits or any other circuit 
capable of generating the necessary logic signals. The 
mode selector 90 may employ a timer circuit or device to 
determine the time interval after which the imaging sys- 
tem 3 will revert back to the differential mode from the 
video mode to determine whether any further motion is 
detected. 

Suitable timing controller circuits 20 for the imaging 
system 3 include microprocessor controllers, finite state 
machine implementations, such as application specific 
integrated circuits, combinational logic circuits or any 
other circuit capable of generating the necessary timing 
signals to the row decoder 1 0 and the plurality of output 
circuits 18. The row decoder 10 may be a counter, a 
demultiplexer or any circuit or device capable of individ- 
ually activating each sensor row 25. Although the row 
decoder 10 is shown separate from the timing controller 
20, a single device or circuit may be employed to perform 
the functions of these two components in accordance 
with the present invention. 

Each active pixel sensor 35 in the array 5 may con- 
sist of a photosite and one or more on-chip transistors to 
provide both gain and buffering functions. Active pixel 
sensor, as used herein, refers to devices commonly 
known in the art as active pixel sensors, as well as any 
other device or sensor configuration which collects and 
stores electrical charge in proportion to detected light 
intensity, and which buffers such stored electrical 
charge. A general description of exemplary active pixel 
sensors 35 is provided in. for example. Fossum. E.R. 
• Active Pixel Sensors: Are CCD s Dinosaurs? '. Proceed- 
ing of SPIE: Charge-Coupled Devices and Solid State 
Optical Sensors III. Vol. 1900. pp. 2-14 (1993). ("Fossum 
reference"), which is incorporated by reference herein. 

An exemplary active pixel sensor 35 and a corre- 
sponding output circuit 1 8 in accordance with the present 
invention are shown in FIG. 2. Referring to FIG. 2. the 
sensor 35 is connected to the output circuit 18 by the 
corresponding column output line 65. Since other sen- 
sors 35 are also connected to the column output line 65. 
the line 65 has been shown broken by ellipses 67 for clar- 
ity The other sensors 35 may preferably operate in a sub- 
stantially identical manner to the sensor 35 shown in FIG. 
2 Only one output circuit 18 has been shown in FIG. 2 
for ease of illustration. The other output circuits 18. 
shown in FIG. 1 . may preferably operate in a substantially 
identical manner to the circuit 18 illustrated in FIG. 2. 

In FIG. 2. the active pixel sensor 35 may be repre- 
sented as a photogate 100 charge-coupled to a transfer 
gate 105 which is further charge-coupled to a diffusion 
well HO. The gates 100 and 105 have gate electrodes 
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101 and 107. respectively. The photogate electrode 101 
is connected to the phctooate control line 1 80 The trans- 
late e,ectrode 107 may be connected to a suitable 

om ? ?. enaWS ?h£ ,ranS ' er of e,ec,ricaI ^arge 
from the photogate 100 to the diffusion well no as is 

descnbed below. E.ectrons ,02 beneath the photogate 
100. electron transfer arrow ,06. and transferred elec- 
trons in the diffusion,.. ell ,,0 represent an electron 
well diagram that illustrates the transfer of electrical 

^Tl 0m H , « ePh0,05a?e 10 °- ,h ™9h the transfer gate 
1 05. to the diffusion well 1,0. 

The active pixel sensor 35 further includes a reset 
transistor 120. a voltage-follower transistor ,25 a select 
transistor 1 30 and a load, such as a suitably biased load 
transistor 135. A diffusion node 1,5 connects the diffu 
sion well 1 1 0 to the reset transistor , 20 and the voltage- 
ollower transistor 125. The reset and voltage-follower 
transistors 120. 1 25 are further connected to a fixed volt- 
age VDD, which will preferably be five volts if the active 
pixel sensor 35 is implemented as a CMOS device The 

.in S . e , , I an S 0r 1 20 15 3150 C ° nneCted t0 ,he reset control 
Une 184 of the control lines 55 that extends from the row 
decoder 10 shown in FIG i. An output ,26 of the volt- 
age-follower transistor 125 * further connected to the 

35 nS,S,0r 1 30 WhiC " !S C ° nneCted ,0 ,he load tran " 
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The load transistor 1 25 is also connected to a fixed 
load voltage VLOAD and a f Ixe d voltage VSS. The fixed 

vo.tageVSSwil.preferab.yb.zero volts if theactivepS 
sensor 35 is implemented as a CMOS device The select 
ransistor 130 is further connected to the select conS 
line 18S of the control lines 55 shown in FIG 1 The load 
voltage VLOAD shoufd be adjusted such that a des°S 

\IIT»Z S iS aCHiW5C £Cr0SS the load '^sister 

lot V<S 9 th ! C ° ,Umn m ' ine 65 and ,he ««d volt- 
age VSS The des,red resistance value should enable 
the trans,stor 125 to operate in a voltage follower mSe 
' efS f Se,eCl ,ranSiS, ° r 130 opera,es in duration ,o 

f a c,osed swrtch between ,he transis »^ 

S S T ^ a,ter ^ <°r the .oad tran SIS ,or 
135 include on-ch,p or surface mount resistors, or any 
other passive or active devces which can provide the 
equi^d e.ectr,ca. resistance when disposed between 
the column output line 65 and the fixed voltage VSS 
The sensor output 50. shown in FIG. 1. is schemat- 

t on node between the select transistor 130 and load 

SS^JT C °' Umn ' ine 65 —as the 

wS S? n COrresD °^9 output circuit 18. 
Wrthm the output circuit 18. the sensor output signal is 
provided to firs, and second switches 140 V 5 ! which 
may bettor examp.e. transistor switches or solid state 

thfsTitch: 140 P0Si,i0nS ' n ,hS dOSed pos *°^ 
55 £T*T ^ 155 ^^pacitors S and 



combiner, such as a differential amplifier i 60 The 
^..che S l 4 o and 145 are contro||ed . ™e 

SI and S2 generated by the timing control circuit 20 

5 Pr a , 0 An ,K° U,PUt 163 °' ,he dif,eren t* a ' amplifier ,60 gen - 
.! ra,eS .^ SenS0r dif,eren ce or video output signal whfch 
« provided to a third sing,e-p 0 , e sing.e-throw stitch , 70 

tlm ?Z?l , ° ' S ,Ur,h6r C ° nnec,ed to ,ne Paging sys 
tem output line 15. The switch 170 operates in an op en 

w S3 Itn *£T 35 COntr ° ,,ed by 3 Switch conlr °' 
>o S3 generated by the timing controller 20. When closed 

the sw.tch 170 provides the sensor difference o' Zt 
output signal to the common output line 1 5 

In operation, whether in differential or video mode 
!5 nh T a r 9SyS,emr ^ deCOdeM0aenera tesasuitable 

TT C °T Si9na ' ° n me pho,OQa,e c °"trol .ine 
180 , 0 cause the photogates ,00 of each sensor 35 in 

h a c^° rreSP ° ndin9 f0W 25 fo co,lect e, ectrical charge 
based on detected light intensities. The photogate ,00 

» I on e r ^ ,O h C0,,eCt e ' eCtriCal Charae over « ^tegra 
20 t on period, wh.ch may be a substantial portion of the 
frame mterval. For instance, if the frame Nerval teS 

ZZn ITrT^Z 9 ,0 30 ' rameS per second - th * inte- 
grator, penod may be 33 msec, less approximately one 

25 d™!c°e SGnSOr 35 iS im P lemen ^ a * a CMol 

decc^r i r mP ' e,i0n °' thS intearafon Period, the row 
decoder 10 may cause the biased transfer gate 105 to 
transfer the collected charge from the photogate 100 to 

so KIT, 5 ' 0 ", 1 10 by 96nera,in9 3 Suitab ' e »** in 
chal ?, !° n,r01 ThiS meth0d of transferring 

charge .s well known in the art and is described in for 
«ample. the above cited Fossum reference. A suitable 

the^f , 6 K Ph ° ,09a,e COn,r °' Si9nal pulse *> cause 
the transfer of the collected electrical charge may be for 

£ 2? • T ° rd6r ° f ° ne mic rosecond Further the 

o if* ?r ;,r te biasing voi,a9e may ° e ° n »• or de r 

of 2.5 volts ,f the sensor 35 is implemented as a CMOS 

40 c*arnT h Z ^ ,ech "iP"e for transferring 

,h<f 9 T an aC,ive Pixel sensor is 10 Cock or pulse 

Both rhT? 9ate e ' eCtr0de Wh6n the ,rans,er is requiri 
Both the b,as,ng and clocking techniques cause the volt- 
age poent,al beneath the transfer gates 105 to be 
greater than that beneath the photogate 1 00. Since elec- 
ts tncal charge moves from regions of lower potential to 
regions of higher potential, the collected charge in the 

to mOV6S t0 ,he tranSfer 9ate 105 and then 

to the diffusion well no. 

so ,h* hT* $enSOr 35 ' ,he e ' ectrical cha r9e maintained in 
iri iS S ;° n 1 10 ' S buff6red ^ ,he ^ansistors 125 
and 130 from signals generated over the corresponding 
column output line 65 by the other sensors 35 in the col 

oiT^ , u tranSfer 93,6 105 ,urtner acts to buffer the 
< s f?L !k 3 f f9e mair, tained in the diffusion well 110 

1 k C ° 6Cted bV ,he phot ° 9a,e 100 at all times 
except when electrical charge is transferred from the 
photogate 100 to the diffusion well 1 10. Accordingly, in 

buttf 'r JZlT m0de ' ,hC ima9in9 Sys,em 3 re»es on the 
buffered d,ffus,on nodes 110 to maintain an electrical 
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the present ^^^^J signal combiner. 160 
devices 150. 155 and differential ou*ut 

SnTSre 1 ^ 

erate a differential output m«* ^ sen . 

,n both the tf^^^SSriod corresponding 
sor 35 operates aK^etecbon^, out period. For a 
to the integration penod ana ^ 25 is 

given detected ^ ' r ^2ii M during a light detec- 
sequentially a ^ fJlecS to generate corresponding 
output signalsdunng the read ou p durjng the 

tion period and read ^T^^ as is described 
respective differential and vrfeo examp)e 

in detail below with ;f*^ F £^. the tight detec- 
W a frame interval of 33 msec. * tion of that 

tion period may cons,* °< * ^ ay be on the order of 
interval, and the read * fig** eri&d . T he row decoder 

10 may further cause £e Wgg^ the desired 
cent sensor rows 25 to over ^ over|ap . 

ira me rate during ^J^^^r* system art 
ping technique .s well Known ^.n method 
FK3. 3 shows a t.m.ng ^^m ° 8 ^ RG 

oi operation of the sensor 35 and ou p waveforms 

200 for an overlapping JgM _dete^ ^ ^ g 
read out period 204 ot t in tegrat.on period 

present frame .nterval Since the g ^ the 

P 202 is much longer than ^^-^es 203 during 
reforms 200 have ^^J*^, care" regions 
the li9 ht detection by cross-hatched 

o, the waveforms 200 a ^ a(m 2 90. 

bars, such as reg.on 2 05 o i h occurs 

- During the light detect on p^nc^ ^ & 
between times ™ *nd TS^tne , i„ustrated 

FIG. 1 . provides the P^f^statetothephotogate 
b y waveform270,.nah,ghvo^g^ ^ ^ hjgh 

electrode ,01 . ^^T^e 100 to collect 
voltage state causes ^the senso p Qn 
electrical charge based on we g con . 
the sensor 35 for the P*""^^ ^rther prevents 
trol signal 270 in *el*voW« collected electri- 

the transfer gate 105 from j^ ^g^r.ghtdetec- 
calchargetothedmus-on^HIIO y^.^^^ 

tion period 202. "J**^, is buffered from the 
maintained in the drffus.o well 1 
photogate 100 dur.ng the ^nt uam{ , s 
period 202 and thus elands tot P ^ ^ ^ 



detection penod 202. detec _ 
Ata timesubstant,a».y near theendo * 9^ io 

tlon per.od ^- ^^^aTngthese.ertcon- 

initiates the read out per,« by g ^ g voHage 

trol signal, illustrated as wave orm ^ g ^ ^ 

state, deselect contro.s.gna»220re ^ ^ 

age state for the durat o o he £ ^ ^ 

transistor 125 to ^^VX^o^r it generates 
transistor 1 25 operates a a vonag signal ^ the 

a voltage at its output ^^ano pQten . 
sensor output 50 ** corre^ tot 
, al 215 at the ^usjon node 1 £ S a ^ ^ T , 
node voltage potential 215 has a ^ ^ 
the output voltage s.g ^Lttime T1 and also 
230 . is proportional to «<»«W detected ligh t inten- 
correspondstothe^ 

%t<z££^«* * n — d - as ,nd,cated 

by the "don't care" ^^oa signa , is generated. 

A short t,me after he «^ ^ ge 
such as at t.me T2. the .m.ng ^ i„ uS trated 

sw.tchcontrols.gnal SI. J U 0. When switch 

as waveform 240. wh.ch closes sw q a voitage pro . 

n 40isclosed.thecapac.tor 150 chag )230 M& 

the capacitor ^ 50 has naa ^» Q . ener - 

^^^^^St^ switch 140 to 

at ed in a low volta f ^^Simes T2 and T3 should 
op en.Thetimedurat.onbetweent fc 

be selected to perm.t the received sensor 

output s.gnal 230. ma P charging time for 

en^imentofthe.nvem.on. asu^ q icrosecond . At 

ates the reset ^P^T^v-orrn 260. This 
a high voltage state, as s ^ n ° y t tra nsistor 120 to 
reset signal pulse 260 diffusion node 

operate in ^^^^Z^- *» ^ 
115 to the voltage VDD. As a jncr eases 

sponding sensor 0U< P a ! *q the voltage VDD. Shortly after 
to a vonaoeproponw^^^ gs ^ , me T5 , the 

the reset pulse has ^JJ* and a low voltage pulse 
,ight detection penod ««««s 270 . 

2 9 75 is generated ^f^ten times T5 and T6. 
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100 to transfer to the diffusion well 110 in a manner 
described above with regard to FIG. 2. 

The transferred electrical charge causes the diffu- 
sion node voltage 2 1 5 and the corresponding output volt- 
age signal 230 to lower in proportion to the amount of 
collected charge representing thedetected light intensity 
for the present frame. The greater the light intensity, the 
greater the amount of collected charge and the lower the 
corresponding diffusion node voltage 215 potential. 
Shortly after time T5, the output voltage signal 230 pro- 
vided to the output circuit 1 8 corresponds to the detected 
light intensity for the present frame which is shown as a 
voltage B. 

After the electrical charge is transferred to the diffu- 
sion well 110, such as at time T7, the timing control 
device 20 closes the second switch 150 by generating 
the switch control signal S2 in a high voltage state, as 
shown by the waveform 280. The closed switch 145 
causes the second capacitor 1 55 to charge to of the sen- 
sor output signal voltage which is the voltage B. At time 
T8, after the capacitor 155 had sufficient time to charge, 
the timing controller 20 opens the switch 145 by gener- 
ating the signal S2 in a low voltage state. 

After time T8. the voltages across the capacitors 1 50 
and 155 correspond to the voltages A and B. respec- 
tively. As a consequence, after time T8. the differential 
amplifier generates a sensor difference output signal 290 
that is a voltage corresponding to the difference between 
the voltages A and B. Prior to time T8. the waveform 290 
consists of the "don't care" region 205. Since the volt- 
ages across the capacitors 150 and 155 represent the 
light intensity detected by the sensor 35 for the previous 
and present frames, the generated sensor difference sig- 
nal represents the difference of the light intensity of the 
frames detected by the sensor 35. 

At the appropriate time, the timing controller 20 gen- 
erates switch control signal S3 to close the switch 170 
which provides the sensor difference output signal to the 
imaging system output line 15. The switch 170 is only 
closed at a particular time and for the proper duration in 
order to insert the sensor differential output signal into 
its proper sequence position within the imaging system 
differential output signal. Each pixel sensor 35 in each 
array row 25 is preferably operated in the same manner 
as is described above with regard to FIG. 3 to generate 
a differential output signal for a frame of a detected 
image. Since the voltage present at the diffusion node 
11 5 of each sensor 35 is buffered from the corresponding 
photogate 100 and column output line 65, it maintains a 
voltage based on an amount of detected light from frame 
to frame. Accordingly, the voltage at the diffusion node 
115 remains a voltage corresponding to the voltage B 
until that sensor 35 again enters a read out period for the 
next detected frame, as shown at time T9 in FIG. 3. Dur- 
ing read out of the sensor 35 for the next frame at time 
T9. the voltage B of the sensor output signal 230 corre- 
sponds to the previous frame s detected light intensity. 

In FIG. 3. the sensor output signal 230 for the two 
consecutive frames is shown having two different voltage 



potent>als for clarity. Thus, FIG. 3 depicts the operation 
of the imaging system 3 when an interframe difference 
is detected representing motion occurring in the viewed 
area. If no motion occurs in the area viewed by the imag- 
5 ing system 3. the sensors' output signal would be equal 
for the two frames and the corresponding difference out- 
put signal would be a voltage level of zero. 

FIG. 4 shows a timing diagram illustrating a suitable 
method of operation of the sensor 35 and output circuit 
io 18 of FIG. 2 in the video mode. In FIGS. 3 and 4 like 
waveform reference numbers and timing references are 
used for clarity, such as the select control signal 220 time 
TO and the light detection phase 202. A video output sig- 
nal waveform 300 is shown in FIG. 4 representing the 
75 generated signal by the output circuit 18. 

The operation of the sensor 35 and corresponding 
output circuit 18 during the light detection period 202 in 
the video mode is substantially identical to that of the dif- 
ferential mode. Accordingly, the photogate enable signal 
20 270 is generated at a high voltage level during the light 
detection period 202 between times TO and T5. Also, the 
read detection period 204 starts at time Tl by the gen- 
eration of the select control signal 220 in a high logic 
state which causes the transistor 125 to operate as a 
25 voltage follower and the sensor output signal 230 to 
appear at the sensor output 50 that represents the volt- 
age 215 at the diffusion node 1 1 5. 

At time T2, the reset signal pulse 260 is generated 
which causes the reset transistor 120 to operate in the 
30 on state and force the diffusion node 1 1 5 to the voltage 
VDD. As a consequence, the sensor output signal 230 
increases to a voltage corresponding to the voltage VDD. 
A short time after the reset signal pulse 275 is generated, 
such as at time T3. the timing controller 20 generates the 
25 switch control signal Si 240 in a high voltage state clos- 
ing switch 140 and causing the capacitor 150 to charge 
to the voltage VDD of the sensor output signal 230. After 
the capacitor 150 has sufficiently charged, such as at 
time T4\ the switch 140 is again opened by generation 
40 of the control signal S1 240 in a low voltage state. 

Shortly after the switch 140 is opened, such as at 
time T5. the light detection period 202 ends and a low 
voltage pulse 275 is generated as the photogate control 
signal 270. This low voltage pulse 275 causes the col- 
45 lected electrical charge in the photogate 100 to transfer 
to the diffusion well 110. The transferred charge causes 
the diffusion node voltage 215 and the corresponding 
output voltage signal 230 to lower in proportion to the 
amount of collected charge to a voltage C which repre- 
50 sents the detected light intensity for the present frame. 
As a consequence, shortly after time T5. the output sig- 
nal 230 having the voltage C is provided to the output 
circuit 18. 

The voltage C of the sensor output signal 230 is then 
'•5 stored by the storage device 155 by closing the second 
switch 150. The second switch 150 is closed by causing 
the switch control signal S2 280 to assume a high logic 
state at time T7. Then, at time T8. after the capacitor 1 55 
had sufficient time to charge, the timing controller 20 
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opens the swrtch 1 50 by generating the control s.gna S2 
280 in a low voltage state. As a consequence, at t.me 
T8 voltages VDD and C are mainta.ned across the 
ILdtors 150 and 155, respectively. Accordingly, after 
S ^differential amp.Hier 16C , generates £v*jo s 
nutnut sianal 300 having a voltage of VDD-G. i ne von 
r g rVDD-C corresponds to the voltage drop thai : occurs 
at the diffusion node voltage 215. shown m FIG. 2, when 
?hf collected electrons representing the amount* 
detecSaht are transferred from the photogate 100 to ,o 
SSEsSi well 111. Thus, after time T8 of the read ou 
periS, the video signal 300 generated by the output 
ScS 18 represents the amount of detected light by that 
sensor for the present frame. 

The timing controller 20 then generates the sw ch ,s 
control signal S3 at the appropriate tome to close he 
c°rtch 170 to provide the sensor output s.gna. to the 
fmaoTng sys em output line 1 5 to insert it into ,ts proper 

vSo oulut signal. Each pixel sensor 35 in each array « 
row 25 is prefe^ly operated in the same manner as ,s 
dTscrfbed above with regard to FIG. 4 to flfn«te a 
vfdeo oS>ut signal for a frame of the detected mage. As 
sSSl above, while the mode selector 90 shown ,n FIG. 
1 Operating the imaging system 3 in the v.deo mode. * 
t is oTntrolling the switch 70 to operate in .ts ^cond »J 
«on to provide the generated video »onai to »e vrieo 
recorder 2 At a predetermined time .nterval later, such 
asTJe minutes, the mode selector 90 reverts the .mag.ng 
s^em back to the differentia, mode and the sw.tch 70 * 
SSJ to its first position to determine if mot.on « st... 
occurrinq in the viewed area. 

Advantages of a camera system accord.ng to the 
presen invention ,nc.ude that the motion ^etegon 
rejn may be precisely defined by sett.ng the field o - 
vtew of the camera system, such as with a oonver*onal 
^ns Furthermore, the field of view and correspond.ngty 
he motion detection region may be adjusted by amp* 
adjusting the camera lens or changing to a different lent 
Anothe'advantage of the present 
threshold detector 80 and mode selector 90 of FIG 1 
may consist of a single circuit, and that the camera sys- 
tem may be implemented on a single semiconductor 

ChiP Although one embodiment of an active pixel sensor -5 
camera system has been described in deta.l above, 
many mSn.cat.ons to the described embodimen are 
possble without departing from the teach.ng of I fte 
present invention. All such modifications are .ntended I to 
Encompassed by the claimed invention. For instance^ 
other conjurations of the mode activat.on orcu-t 4 may 
beusedbythepresentinventionincludingasmglearcurt 
to peSrm the'operations of the threshold detector 80 
anS the mode selector 90. m addition^surtable . aHema- 
tive uses for the camera system include baby and hos - 
SIl patient monitoring and car alarms. Since act.ve p.xel 
senirs may detect infra-red light, a cam era system 
according to the present invention may view a dark area 
of interest by illuminating the darkarea w.th .nfra-red light 



and operate in a substantially identical manner as-that 
described above. 

Also within the imaging system 3. the output c, curt 
1 8 mav use one single-throw double-pole swrtch .nstead 
ofthe L itches 140, 145, or may consist of any con- 
JSfcn of components capable of prov.d.ng two sen- 
X Reived voltage signals to a signal cornb.ner .n a 
SaS fashion, and generating a difference s.gnal 
based on the two voltage signals. In addition . other actrve 
pfxefsenir implementations with different vo.tagesmay 
be readily employed. 



Claims 

1 a motion detection camera system comprising: 

an active pixel imaging system hav.ng an out- 
put and a mode select input, the imaging sysl em 
be ng operable in a differential or video mode based 
on the signal at the mode select input. wherem , the 
imaging system generates a video signa containing 
information for each detected image frame o, a 
viewed area when in the video mode and a d.ffe en 
tial signal containing information of interframe d.ff er- 
ences when in the differential mode; 

a switch having an input, first and second out- 
puts and a control input, the input being connec : ed 
to the imaging system output, the f irst o^t being 
operable to provide a video output signal to a mon- 

itoring device; . 

a threshold detector having an .nput and an 
output, the input being connected to the second 

switch output; and 

a mode selector having an input and an out 
put. the input being connected to the detector output 
the output being connected to the swrtch control 
input and the imaging system mode select input. 

2 The camera system of claim 1. wherein the mode 
selector is operable to cause the imag.ng system to 
revert to the differential mode after being in the video 
mode for a predetermined time interval. 

3. The camera system of claim 1 . wherein the imaging 
system further comprises. 

a plurality of active pixel sensors arranged n 
an array, each active pixel sensor being operable to 
generate a voltage at a diffusion node correspond; 
lg to detected light intensity by the sensor each 
active pixel sensor being further operable to buffer 
the voltage potential present on the diffusion node 
rom othe'r signals generated externa, to the sensor. 

means for sequentially act.vat.ngj sensors n 
different portions of the array for a penod of t.me to 
achieve a desired detected frame interval. 

a plurality of output circurts, each output cir- 
cuit being connected to the respective sensors in a 
corresponding portion of the array, each output ar^ 
cuit being operable to store f irst and second vottage 
Sgnals received from the connected sensors and to 
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selectively provide a sensor output signal to the 
imaging system output; and 

a timing controller connected to the activating 
means and each differential output circuit. 

5 

4. The camera system of claim 3, wherein the activat- 
ing means is a row decoder. 

5. The camera system of claim 3, wherein the array 
sensors are arranged into rows and columns, and -io 
the timing controller is operable to cause each sen- 
sor row to be sequentially activated, and when in a 
differential mode, to cause the activated sensors to 
provide a voltage signal corresponding to a previous 
detected frame to the output circuits and then to pro- is 
vide a voltage signal corresponding to a present 
detected frame to the output circuits, and when in a 
video mode, to cause the activated sensors to pro- 
vide a voltage signal corresponding to a reference 
voltage to the output circuits and then to provide a 20 
voltage signal corresponding to a present detected 
frame to the output circuits, and wherein the timing 
controller is further operable to cause the output cir- 
cuits to sequentially provide the output signals to the 
common output line to generate either of the imaging 25 
system output signals. 

6. The system of claim 3, wherein the output circuit 
comprises: 

first and second switches connected to the 30 
sensors; 

first and second charge storage devices con- 
nected to respective first and second switches, 
wherein the switches are controlled by the timing 
controller to provide the first and second voltage 35 
potentials to the charge storage devices; and 

a subtractive signal combiner having first and 
second inputs and an output, the first and second 
inputs being connected to the first and second 
charge storage devices wherein the output signal is 40 
generated at the subtractive signal combiner output. 

The camera system of claim 6, wherein the output 
circuit further comprises: 

a third switch connected to the signal com- 45 
biner output and the common output line, wherein 
the timing controller controls the third switch to close 
during the time the corresponding sensor output sig- 
nal is to be provided to the output line. 



The camera system of claim 1. wherein the active 
pixel imaging system, the switch, the threshold 
detector and the mode selector are implemented on 
a single semiconductor chip. 

A method for a motion detection camera system 
employing an active pixel imaging system operable 
in a differential or video mode comprising: 

operating the imaging system in the differen- 
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tial mode to generate an imaging system output sig- 
nal as a differential signal containing information of 
the interlrame difference of a viewed area; 

detecting whether the differential output sig- 
nal has a signal level that deviates by greater than 
a threshold value, wherein a deviation in the differ- 
. ential output signal indicates motion within the 
viewed area; 

operating the imaging system in the video 
mode upon detecting that the differential output sig- 
nal level has deviated greater than the threshold 
value, wherein the imaging system generates the 
output signal as a video signal containing informa- 
tion for detected frame; and 

providing the video output signal to a moni- 
toring device. 

1 0- The method of claim 9, further comprising the step 
of reverting the operation of the imaging system 
back to the differential mode upon an expiration of a 
predetermined time interval after the imaging sys- 
tem has been operating in the video mode. 

1 1 . The method of claim 9. wherein the imaging system 
comprises an array active pixel sensors, each sen- 
sor capable of collecting electrical charge based on 
a detected light intensity and having a diffusion well 
capable of holding an amount of electrical charge, 
each diffusion well being buffered from electrical sig- 
nals generated external to the sensor, and wherein 
the step of operating the imaging system in the dif- 
ferential mode comprises: 

sequentially activating sensors in different 
portions of the array for a period of time to achieve 
a desired detected frame interval; 

detecting a first voltage potential at a diffusion 
node of each activated sensor, wherein each of the 
first voltage potentials correspond to collected 
charges held by the respective diffusion wells for the 
image of the viewed area at a corresponding imme- 
diate previous frame; 

resetting the voltage potential of the respec- 
tive diffusion nodes of the activated sensors to a ref- 
erence voltage potential; 

transferring electrical charges collected for a 
present frames detected light intensity from the 
image by each activated sensor to corresponding 
diffusion wells within the respective sensors, the 
voltage potentials at the activated sensors' diffusion 
nodes changing from the predetermined voltage 
potential to second voltage potentials corresponding 
to the respective amounts of transferred electrical 
charges; 

detecting the second voltage potentials at the 
diffusion nodes of the activated sensors; and 

generating the differential output signal 
based on sequentially determining the difference 
between the detected first and second voltage 
potentials of the activated sensors, wherein the 
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u of the viewed area at the corresponding pixel' sen- 

sequential activation of the sensors .n each port-on d£e 
ofthe array generates an output signal of sequential 
segments of the detected differences in the .mage 
of the viewed area at the corresponding p.xel sen- 
sors between the previous and present frames. 

12 The method of claim 1 1 wherein the step of gener- 
ating the differential output signal further compr.ses 
the step of determining the difference between he 
detected first and second voltage potent^ .n the .„ 
activated sensor row using respect.ve different* 
output circuits connected to a respective act IV e pixel 
sensor in each of the portions of the array. 

1 3. The method of claim 1 1 further comprising the steps is 

0i storing the first voltage potential of each acti- 
vated sensor in a respective one of a first plurality of 

rharae-storage devices; and 

storing the second voltage potential of each 20 

activated sensor in a respective one of a second plu- 
rality of charge storage devices, where.n the step of 
generating the output signal includes applying the 
Respective voltage potentials in each of the first and ^ 
second pluralities of the charge storage devices to - 
a like plurality of subtractive signal combiners that 
sequentially generate the corresponding portions of 
the differential output signal. 

14 The method of claim 1 1 wherein the step of operat- 30 
' ing the imaging system in the video mode com- 

PnSeS "sequentially activating sensors in different 
portions of the array for a period of time to achieve ^ 
a desired detected frame interval, 

resetting the voltage potential of the respec- 
tive diffusion nodes of the activated sensors to a ref- 
erence voltage potential; .,..,-« 

detecting a first voltage potential at a diffusion 
node of each activated sensor, wherein each of the *o 
first voltage potentials correspond to the reference 

voltage potential; 

transferring electrical charges collected for a 
present frames detected light intensity from the 
image by each activated sensor to corresponding as 
diffusion wells within the respective sensors, the 
voltage potentials at the activated sensors' diffusion 
nodes changing from the reference voltage potential 

to second voltage potentials corresponding to the 
respective amounts of transferred electrical so 

° har9e detecting the second voltage potentials at the 
diffusion nodes of the activated sensors, and 

generating the video output signal based on 
sequentially determining the difference between the ss 
detected first and second voltage potentials of the 
activated sensors, wherein the sequential activation 
of the sensors in each portion of the array generates 
an output signal of sequential segments of the .mage 
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